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Two  Papers  on  the  Methods 
of  Evaluating  the  Quality 
of  Solar  Proton  Event  Forecasts 
From  the  People's  Republic  of  China 

PART  l 

A  Method  for  Evaluating  the  Quality 
of  Solar  Proton  Event  Forecasts 

Zhen-xing  Cui 


1.  INTRODUCTION 

Solar  forecasting  involves  the  scientific  prediction  of  solar  proton  events.  To 
evaluate  this  kind  of  prediction,  one  has  to  select  an  appropriate  indicator  impor¬ 
tant  for  the  design  of  forecast  criteria,  the  improvement  of  forecasting  methods, 
and  the  assessment  of  the  work  at  hand. 

The  common  indicators  used  have  been  the  probability  of  accurate  forecast 
(PAF)  and  the  probability  of  erroneous  forecast  (PEF)  of  solar  proton  events  and 
the  PAF  and  the  PEF  of  the  safe  (or  quiet)  period  (that  is,  predicting  the  non¬ 
occurrence  of  solar  proton  events).  However,  it  is  recognized  that  there  is  a 
limit  to  the  usefulness  of  these  indicators.  They  cannot  be  used  separately,  nor 
can  they  be  employed  simultaneously.  Thus,  the  question  whether  it  is  possible 
to  have  a  combined  indicator  that  gives  an  overall  evaluation  of  the  quality  of  fore¬ 
casts  always  arises.  This  paper  attempts  to  propose  an  answer  —  an  equation  that 
suggests  a  combined  indicator.  Surely,  one  can  propose  different  combined  indi¬ 
cators  according  to  the  nature  of  the  problem  and  the  requirements  in  practice. 
Nevertheless,  a  good  combined  indicator  should  be  simple,  and  should  have  clear 
physical  implications. 


(Received  for  publication  25  October  1979) 
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2.  PROBLEMS  ASSOCIATED  WITH  THE  COMMON  INDICATORS 


The  result  of  the  prediction  of  solar  proton  events  can  be  represented  by  four 
independent  basic  quantities.  They  are  2,  the  total  number  of  days  of  observa¬ 
tion;  n,  the  number  of  days  in  2  when  a  proton  event  occurs  (or  n^,  the  number  of 
occurrences);  k,  the  number  of  days  in  2  when  a  proton  event  is  forecast  to  occur 
(or  kg,  the  number  of  occurrences  that  is  predicted);  and  m,  the  number  of  days 
in  2  when  a  proton  event  is  accurately  forecast  (or  m^,  the  number  of  occurrences 
that  is  accurately  predicted).  Since  four  independent  basic  quantities  are  involved, 
four  indicators  are  generally  required  to  evaluate  the  quality  of  the  forecast.  The 
four  commonly  used  indicators  are  the  PAF  and  the  PEF  of  solar  proton  events 
and  the  PAF  and  the  PEF  of  the  safe  period.  The  PAF  of  solar  proton  events  is 
defined  by  the  number  of  days  when  a  proton  event  is  accurately  predicted  divided 
by  the  number  of  days  when  a  proton  event  occurs,  while  the  PEF  of  solar  proton 
events  is  defined  by  the  number  of  days  when  a  proton  event  is  erroneously  pre¬ 
dicted  divided  by  the  number  of  days  when  a  proton  event  is  predicted  to  occur. 

Let  2,  n,  k,  and  m  be  defined  as  above.  Then,  the  number  of  days  when  a  proton 
event  is  erroneously  predicted  is  given  by  k  -  m.  It  should  be  noted  here  that  the 
safe  period  or  the  nonoccurrence  of  events  is  the  converse  of  the  occurrence  of 
events.  It  follows  from  the  diagram  below  that  the  number  of  days  in  the  safe 
period  is  given  by  ac"  +  ef  =  2  -  n,  the  predicted  number  of  days  by  aF  +  dT  =  2  -  k, 
the  number  of  accurately  predicted  days  by  f  =  ab  +  ef  =  2  -  n  -  k  +  m,  and  the 
number  of  erroneously  predicted  days  by  die  -  2  -  C  -  k. 


n  (number  of  days  when 

event  occurs) 


m  (number  of  days  when  event  is 
accurately  predicted)  - 


a 


v. 


e  f 

k  (number  of  days  when  event  is 
predicted  to  occur) 


2  (total  number  of  days) 


Let  a  and  y  be  the  PAF  and  the  PEF  of  solar  proton  events  and  X  and  6  be  the 
PAF  and  t,he  PEF  of  the  safe  period.  Then, 
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k  -  m 
k 


(2) 


X 


J _ 

£  -  n 


(3) 


*  S  -  k  -  I 
£  -  k 


<4) 


The  biases  of  these  indicators  are  obvious.  For  example,  an  increase  of  k  will 
result  in  a  corresponding  increase  of  a.  In  the  extreme  case,  a  =  1  if  proton 
event  is  predicted  to  occur  every  day,  which  is  trivial.  Similarly,  in  the  case  of 
the  PEF,  little  or  no  prediction  which  is  based  solely  on  the  accuracy  of  the  indi¬ 
cator  will  result.  If,  however,  all  four  indicators  are  used  simultaneously,  de¬ 
termination  of  the  quality  of  the  forecast  is  still  difficult.  Consider,  for  example, 
two  forecasting  methods,  X  and  Y.  The  results  obtained  using  method  X  are 
PAF  =  60  percent  and  PEF  =  40  percent  and  those  with  method  Y  are  PAF  =  40 
percent  and  PEF  =  20  percent.  Although  the  PAF  using  method  X  is  higher  than 
that  with  method  Y,  the  PEF  is  also  higher,  and  therefore,  it  is  difficult  to  con¬ 
clude  which  one  of  these  two  methods  is  superior. 

The  usefulness  of  these  Indicators  also  depends  on  the  frequency  of  proton 
events.  If  events  are  frequent  within  a  certain  time  span,  then  the  PAF  will  be 
high  and  the  PEF  will  be  low.  Hence,  the  use  of  these  indicators  cannot  reflect 
objectively  the  quality  of  the  forecast.  This  point  should  be  particularly  noted  in 
view  of  the  fact  that  there  will  be  a  substantial  increase  in  the  number  of  proton 
events  during  the  peak  of  solar  activity.  Furthermore,  during  such  a  high  fre¬ 
quency  of  activity,  the  use  of  a  single  indicator  does  not  have  clear  significance, 
since  the  chances  of  guessing  the  correct  number  of  events  can  be  very  high.  For 
example,  if  it  is  thought  that  almost  80  percent  of  every  year  falls  within  the  safe 
period,  it  can  be  argued  that  a  probability  of  85  percent  of  accurate  forecast  is  not 
necessarily  a  good  indicator  of  quality  prediction. 

The  above  problems  arise  mainly  because  of  the  inherent  limits  of  the  individ¬ 
ual  indicators.  Yet,  the  concurrent  use  of  all  four  indicators  lacks  the  criteria 
for  mutual  comparison. 


3.  RANDOM  FORECAST 

To  overcome  the  difficulties  encountered  when  the  above-mentioned  indicators 
are  employed,  we  introduce  here  the  concept  of  random  forecast.  This  technique 
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is  independent  of  the  frequency  of  events  and  the  predicted  number  of  days,  and 
the  quality  of  the  forecast  work  can  be  assessed  objectively  when  the  results  are 
compared  with  those  of  the  actual  forecast.  The  results  from  different  forecasts 
based  on  different  criteria  or  algorithms  can  also  be  compared. 

For  convenience  sake,  we  rename  the  probability  of  erroneous  forecast  (PEF) 
as  the  accuracy  of  the  forecast,  which  is  defined  as  accuracy  =  1  -  PEF.  Let  [3 
and  e  be  the  accuracy  of  forecast  for  proton  event  and  safe  period,  respectively. 
Then 

0  =  1  -  7  =  x  (5> 

5 

e  -  l-6.  j—p  (6) 

From  hereon,  a,  0,  6,  and  e  will  be  referred  to  as  the  sub -indicators. 

Strictly  speaking,  random  forecast  has  no  physical  interpretation.  It  simply 
makes  use  of  the  most  probable  outcome  that  would  be  obtained  if  an  average 
probability  is  used. 

Assume  that  the  four  basic  quantities  in  forecast  practice  are  E,  n,  k,  and  m, 
as  defined  previously,  and  the  corresponding  indicators  are  a,  f3,  X,  and  e,  as 
given  in  Eqs.  (1),  (5),  (3)  and  (6),  respectively.  Then,  for  comparison,  we  will 
find  the  most  probable  result  of  k  when  a  random  forecast  is  used.  Since  a  proton 
event  occurs  in  n  of  S  days  of  observation,  it  follows  that  the  average  probability 
of  the  daily  occurrence  of  events  is  given  by  P  =  n/E.  Let  m'  be  the  mot.  probable 
number  of  days  when  a  proton  event  is  accurately  predicted.  Then,  m'  =  Pk  = 
nk/E.  Thus,  the  four  basic  quantities  for  random  forecast  are  E,  n,  k,  and  m', 
and  the  corresponding  sub-indicators  are  o’,  f}',  X',  and  e'.  It  follows  from  pre¬ 
vious  definitions  that 


.  m'  k 
®  =  n  =  E 


m  .  I’ll  -  JL 
°  "  k  '  E 


X'  = 


€' 


E  -  n 


=  1 


_k 

E 


(7) 

(8) 

(9) 


€'  = 


?' 


k  1  E 


(10) 


The  ratio  of  the  sub-indicators  of  actual  forecast  to  the  corresponding  sub¬ 
indicators  of  random  forecast  gives  a  comparison  on  the  quality  of  the  forecast 


A  =  — ,  =  — 

(ID 

a'  rj 

B  ■  j' '  a 

(12) 

C  =  x 

c  T»  l  -  n 

(13) 

(14) 

D  e'  r^r 

where  rj  =  k/S  is  the  ratio  of  the  number  of  days  when  a  proton  event  is  predicted 
to  occur  to  the  total  number  of  days  of  observation.  Obviously,  the  quality  of  the 
actual  forecast  is  better  than  that  of  the  random  forecast  only  if  A  =  B  >  1  and 
C  =  D  >  1.  Otherwise,  the  forecast  is  meaningless  since  the  best  it  can  give  is 
the  same  as  that  one  would  obtain  by  doing  a  random  forecast,  A  =  B  and  C  =  D. 


4.  COMBINED  INDICATOR 


If  we  consider  that  proton-event  and  safe-period  forecasts  are  of  equal  impor¬ 
tance,  then  the  product  of  A  and  C  will  give  the  ratio  of  the  quality  of  the  actual 
forecast  to  that  of  the  random  forecast.  Hence,  we  can  consider  a  combined  indi¬ 
cator  g  such  that 


g 


AC 


n(l  -  v)  * 


(15) 


The  above  discussion  is  based  on  the  number  of  days.  The  corresponding 
equation  based  on  the  number  of  occurrences  is  given  by 


o-qX 


g0  =  nd  *  n) 


(16) 


where  Oq  =  mg/n^,  with  being  the  number  of  occurrences  of  events  that  is 
accurately  predicted  and  nQ  bein^the  number  of  occurrences.  The  symbols  A  and 
t)  are  the  same  as  those  defined  previously. 
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Let  us  now  consider  the  following  properties  of  g: 

(1)  The  meaning  of  g  is  explicit.  From  the  above  derivations,  we  can  see 
that  g  is  the  overall  ratio  of  the  quality  of  an  actual  forecast  to  that  of  a  random 
forecast.  The  actual  forecast  is  useful  only  if  g  >  1.  The  larger  the  value  of  g 
implies,  the  more  accurate  the  forecast. 

(2)  The  combined  indicator  g  is  applicable  even  in  the  extreme  cases.  For 
example,  while  the  PAF  is  equal  to  one  if  a  proton  event  is  predicted  to  occur 
everyday,  the  PAF  of  the  safe  period  is  zero,  which  is  meaningless.  However, 
the  value  of  g  in  this  case  is  indeterminate  and  can  be  treated  as  a  singular  point 
(g  =  0/0),  and  therefore,  g  can  eliminate  the  trivial  results  implied  by  the  sub¬ 
indicators  under  extreme  conditions. 

(3)  The  combined  indicator  g  can  be  used  not  only  to  assess  the  quality  of  the 
forecast  but  also  to  determine  whether  events  and  the  criteria  used  are  positively, 
negatively  or  zero  correlated.  To  further  this  point,  we  first  prove  a  property  of 
g,  namely,  the  necessary  and  sufficient  condition  for  g  >  1  is  a  >  r).  The  proof  is 
as  follows: 

If  a  >  rj,  that  is,  m/n  >  k/E  and  Em  >  nk,  then 

Ek  -  nk  >  Ek  -  Sm, 

2  2  -  n 


and 


1 


k  -  m 
S  -  n 


that  is 


1  -  rj  < 


1  -  1 


>  1 


Consequently 


a* 

g  *  n(i  -  v) 


>  l  . 


Similar  reasonings  will  show  that  g  <  1  if  a  <  rj. 

The  above  property  indicates  that  the  forecast  is  meaningful  only  if  the  ratio 
of  the  number  of  days  when  a  proton  event  is  predicted  to  occur  to  the  total  number 
of  days  of  observation  is  smaller  than  the  accuracy  of  the  forecast.  This  is  com¬ 
monly  known  as  the  degree  of  success  in  forecast  practice.  For  example,  if  a 
forecast  is  done  using  30  percent  of  the  total  number  of  days,  then  the  degree  of 
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the  forecast  is  high  if  the  accuracy  is  40  percent;  the  degree  of  success  is  low  if 
the  accuracy  is  20  percent. 

In  which  follows,  we  shall  discuss  the  ways  of  determining  the  properties  of 
the  forecast  criteria.  Let  S  denote  solar  proton  events  and  R  the  forecast  criteria. 
Then,  using  the  same  L,  n,  k,  and  m  notations  and  provided  that  R  holds  true,  k 
is  the  number  of  days  when  a  proton  event  is  forecast  to  occur  and  m  is  the  num¬ 
ber  of  days  when  S  is  accurately  predicted.  Therefore,  the  probability  of  occur¬ 
rence  of  S  based  on  R  is  P(s]  R)  where 

P(S|  R)  =  —■  .  (17) 

On  the  other  hand,  it  is  known  from  the  theory  of  probability  that  the  conditional 
probability  of  S  with  respect  to  R  is  Pq(s|  R),  given  by 

po<slR)  1  — |rR-f)  d«> 

where  P(R)  is  the  probability  of  occurrence  of  R  and  P(S  •  R)  is  the  probability  of 
simultaneous  occurrence  of  S  and  R.  If  R  and  S  are  zero  correlated,  then 

P(S  •  R)  =  P(S)P(R)  (19) 

where  P(S)  is  the  probability  of  occurrence  of  S.  Obviously, 

P(S)  =  .  (20) 

Substituting  Eqs.  (19)  and  (20)  into  Eq.  (18),  we  get 

P0(S|R)  =  y  .  (21) 

If  P(S|  R)  =  Pq(s|  R),  then  R  and  S  are  zero  correlated.  R  and  S  are  positively 
correlated  if  (P(s|  R)  Pg(s!  R)  and  negatively  correlated  if  P(S|  R)  <  Pq(S|  R). 

These  values,  according  to  Eqs.  (18)  and  (21),  correspond,  respectively,  to 
o-t\,  o^n,  and  o  <  n.  Hence,  according  to  the  above-mentioned  properties  of  g, 

R  is  zero  when  g  -  1;  R  is  positive  when  g  >1  and  negative  when  g  <  1. 

(4)  Under  the  conditions  given  to  R  mentioned  above,  g  and  o.'r)  are  equivalent. 
Let  us  now  examine  g  and  n'r\  under  different  conditions,  since,  from  these  differ¬ 
ences,  it  can  be  shown  that  the  use  of  g  can  provide  a  more  reasonable  assess¬ 
ment  of  the  quality  of  forecasts. 
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For  example,  method  X  makes  use  of  30  percent  of  the  total  number  of  days 
of  observation  <rj^  =  30  percent)  and  the  accuracy  of  forecast  is  60  percent  (a^  - 
60  percent),  while  method  Y  employs  40  percent  of  the  total  number  of  days  of 
observation  (n^  -  40  percent)  and  the  accuracy  is  80  percent  (o^.  =  80  percent). 
In  terms  of  the  ratio  o'n,  the  results  are  equal;  however,  they  are  not  equal  if  g 
is  used,  that  is. 


This  shows  that  the  quality  of  the  forecast  using  method  Y  is  better  than  that  using 
method  X,  which  is  reasonable,  since  the  accuracy  is  20  percent  higher  as  com¬ 
pared  to  the  10  percent  more  time  used  in  the  forecast.  The  use  of  o/r]  does  not 
show  which  one  of  these  two  methods  is  superior. 

(5)  We  will  now  discuss  the  problem  of  normalization  of  g.  Since  generally 
the  value  of  g  (or  g^)  is  greater  than  1,  this  does  not  conform  with  the  usual 
practice  of  using  a  percentage  to  represent  the  quality  of  forecasts.  Moreover, 
what  is  usually  concerned  is  how  far  the  forecast  is  from  the  best  possible.  Hence, 
there  .  ■  the  necessity  of  normalizing  g. 

The  best  possible  forecast  is  when  k  n  m,  that  is,  when  both  the  number  of 
days  when  a  proton  event  occurs  and  the  number  i.f  d«.ys  of  the  safe  period  are 
accurately  predicted.  Then,  the  combined  indicator  g  tak-s  on  the  maximum 
value 


g, 


mu  n(S  -  n) 


(22) 


With  a  random  forecast,  g  1  and  we  can  let  G  be  the  normalized  combined 
indicator,  given  by 


G 


g  ~ 
®mu 


1 


(23) 


The  corresponding  equation  based  on  the  number  of  occurrences  is  given  by 


G 


0 


gQ  ~  1 
gmu  *  * 


(24) 
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Obviously,  the  quality  of  an  actual  forecast  is  better  than  that  of  a  random 
forecast  only  if  G  >  0.  The  maximum  value  G  =  1  represents  the  best  forecast 
quality.  G  <  0  implies  that  the  criteria  is  negative,  and  the  forecast  approach 
should  be  reversed. 

(6)  The  above  discussion  has  been  based  on  the  assumption  that  proton-event 
and  safe-period  forecasts  are  equally  important.  If,  for  the  sake  of  avoiding 
"misses,"  emphasis  on  proton-event  prediction  is  desired,  then  the  combined 
indicator  before  normalization  can  be  written  as 


« '  ■  (f  )*  (rh/ 


where  both  x  and  y  are  greater  than  or  equal  to  1.  These  weight  indices  (x  and  y) 
depend  on  the  practical  requirements  of  proton-event  and  safe-period  forecasts. 
The  maximum  value  of  g  then  is  given  by 


“mu  x 


nx(S  -  n^ 


and  the  normalized  combined  indicator  by 


®mu  ~  1 


It  is  hoped  that  the  use  of  the  combined  indicator  G  will  lead  to  a  significant 
improvement  in  forecast  quality. 


m 


PART  2 

A  Suggestion  on  the  Improvement  of 
the  Criteria  for  Evaluating  the  Quality 
of  Solar  Proton  Event  Forecasts 

Stun-ji*  Qian 


In  the  article  "A  method  for  evaluating  the  quality  of  solar  proton  event 
forecasts"  by  Cui  Zhen-xing,  1  the  concept  of  random  forecast  was  introduced  and 
a  combined  indicator  for  assessing  the  quality  of  forecasts  was  suggested.  The 
present  author  found  that  this  combined  indicator  has  certain  defects  in  its  appli¬ 
cation,  and  some  suggestions  for  improvement  will  be  presented  in  this  article. 

Four  basic  quantities  are  involved  in  predicting  solar  proton  events.  They 
are  2,  n,  k,  and  m  (whose  meaning  is  the  same  as  in  Cui's  article).  *  In  assess¬ 
ing  the  quality  of  different  forecasting  methods,  2  and  n  are  common  and  fixed  so 
only  two  independent  quantities,  k  and  m,  are  required  to  be  considered.  These 
two  indicators  (for  example,  a  and  y)  are  usually  used  to  illustrate  the  quality  of 
the  forecasts.  In  these  cases,  X  and  a  will  not  be  independent  indicators  and  can 
be  expressed  in  terms  of  a  and  y.  The  two  indicators  used  in  Cui's  article  were 
in  fact  (A,  C)  instead  of  (a,  7).  in  practice,  a  single  combined  indicator  which  en¬ 
ables  a  comparison  of  different  methods  to  be  made  in  a  simple  and  reasonable 
manner  is  preferred  to  using  two  separate  indicators.  For  this  reason,  in  Cui's 


(Received  for  publication  25  October  1979) 

1.  Chu,  Zhen-xing  (Tsu,  Chen-hsing)  (1975)  A  method  for  evaluating  the  quality  of 
solar  proton  event  forecasts,  Acta  Astron.  Sinica  16(1):6-11.  English  trans¬ 
lation:  ID(RS)I-1 198-76,  Foreign  Technology  Division  (A FSC),  U.S.  Air  Force. 

The  meaning  of  the  symbols  appearing  in  the  article  is  given  in  the  Appendix  by 
the  translator. 
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article,  A  and  C  were  combined  to  form  a  single  indicator  g  =  AC.  However,  this 
indicator  has  the  following  three  defects: 

(1)  Because  solar  proton  events  are  small  probability  events,  C  usually 
approaches  1  and  g  almost  equals  A: 

(2)  the  indicator  A  only  reflects  the  average  of  success  in  forecasting  the 
occurrence  of  solar  proton  events  and  is  unable  to  provide  any  indication  of  the 
frequency  of  "misses."  Thus,  in  Cui's  article  the  numbers  of  occurrences  of 
solar  proton  events  missed  by  methods  X  and  V  are  different  but  tl.eir  values  of 
A  are  equal.  When  the  combined  indicator  g  is  used  the  probability  of  the  events 
missed  io  reflected  by  C  which,  however,  is  not  very  sensitive; 

(3)  because  of  (2),  we  cannot,  by  raising  the  power  of  A  (for  example,  by 
defining  g  =  A  C,  x  >  1),  minimize  the  number  of  events  missed  by  the  forecasts. 

The  above  defects  of  g  can  be  clearly  seen  from  Table  1.  We  have  chosen 
(A,  a)  as  independent  quantities  with  the  corresponding  values  of  g  listed  (taking 
T,  =  100  and  n  =  10).  It  can  be  seen  from  this  table  that  g  is  slightly  greater  than 
A  and  is  not  sensitive  to  variations  in  a.  As  a  result,  the  isolines  g  =  constant 
(that  is,  isopleths  of  equal  forecasting  skill  or  quality)  are  close  to  the  A  =  constant 
lines.  It  is  not  difficult  to  see  from  this  table  the  validity  of  the  statement  given 
in  (3)  above. 


Table  1.  Values  of  g  =  AC  (with  2  =  100,  n  =  10) 


0.  10 

0.  20 

0.30 

0.40 

0.  50 

0.  60 

0.70 

0.  80 

0.90 

1.00 

1.00 

1.00 

1.00 

1.  00 

1.00 

1.00 

1.00 

1.00 

1.00 

1,00 

2.01 

2.02 

2.04 

2.06 

2.07 

2.  10 

2. 12 

2.  15 

2. 18 

2.22 

3.02 

3.05 

3.08 

3.  10 

3.  13 

3. 17 

3.20 

3.24 

3.29 

3.33 

4.04 

4.07 

4.  11 

4.  15 

4.  19 

4.24 

4.28 

4.33 

4.39 

4.44 

5.05 

5. 10 

5.  14 

5.20 

5.25 

5.30 

5.36 

5.43 

5.49 

5.  56 

6.05 

6. 11 

6. 17 

6.24 

6.  31 

6.37 

6.  44 

6.  51 

6.  59 

6.67 

7.07 

7.  14 

7.21 

7.28 

7.36 

7,43 

7.52 

7.60 

7.69 

7.  78 

8.08 

8.  16 

8.24 

8.33 

8.42 

8.  50 

8.60 

8.  69 

8.  79 

8.  89 

9.09 

9. 18 

9.28 

9.37 

9.47 

9.  58 

9.  68 

9.78 

9.  89 

10.0 

10.  1 

10.2 

10.3 

10.4 

10.5 

10,6 

10.8 

10.9 

11.0 

11.1 

To  overcome  these  defects  the  following  indicators  are  proposed  and  con¬ 
sidered,  which  appear  to  provide  a  more  reasonable  assessment. 

In  assessing  the  quality  of  solar  proton  event  forecasts  let  us  use  the  indicatoi 

D:  =  Aa 

(here,  we  assume  A  >  1,  that  is,  we  do  not  consider  those  methods  which  are 
worse  then  random  forecasts  with  A  ■<  1). 

In  assessing  the  quality  of  forecasts  of  tranquil  or  quiet  periods  (that  is,  pre¬ 
dicting  the  non-occurrence  of  solar  proton  events)  let  us  use  the  indicator 

d2  =  cx 

We  shall  define  our  combined  indicator  as 

D  -  DlD2  =  ACX«  =  g**  =  [{f  (l-T^)]2K(rrK) 

(where  N  =  n/S,  M  =  m/S,  and  K  =  k/£).  The  values  of  D  are  listed  in  Table  2. 
The  isopleths  D  =  constant  are  from  a  family  of  hyperbolas.  They  reflect  the  de¬ 
grees  of  success  as  well  as  chances  of  misses  of  a  method  in  forecasting  the 
occurrences  of  solar  proton  events.  In  the  two  extreme  cases  of  "forecasting  the 
occurrence  of  solar  proton  events  every  day"  and  "forecasting  absence  of  activity 
every  day, "  D  does  not  take  on  an  odd  value  but  assumes  a  value  of  zero. 

Of  course,  we  may  form  other  combined  indicators  to  emphasize  some  par¬ 
ticular  aspect  relating  to  the  quality  of  the  forecasts  by  the  power  raising  tech¬ 
nique.  However,  these  indicators  have  to  be  functions  or  (M,  K)  and  the  way  to 
combine  two  independent  indicators  to  form  a  single  indicator  is  dictated  by  the 
generally  accepted  view  as  to  what  form  the  isopleths  of  forecast  skill  or  quality 
should  take. 
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Table  2.  Values  of  D  =  ACAo  (with  S  =  100,  n  =  10) 


$ 

Including  forecasts  of  non -occurrence  of  solar  proton  events  (absence  of 
activity)  every  day. 

^Occurrence  of  solar  proton  event  forecast  every  day. 

^Best  forecasts. 
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Appendix 

Dsfinitiom 


The  following  is  extracted  from  the  article  "A  method  for  evaluating  the 
quality  of  solar  proton  event  forecasts"  by  Cui  Zhen-xing  (Acta  Astronomica 
Sinlca,  16(1):6-11,  1975]: 

£  is  the  total  number  of  days  of  observation. 


n  is  the  number  of  days  (in  £)  when  solar  proton  event  occurred, 

k  is  the  number  of  days  (in  £)  when  solar  proton  event  was  forecast  to  occur, 

m  is  the  number  of  days  (in  £)  when  occurrence  of  solar  proton  event  was 

correctly  forecast, 

a  =  m/n  is  the  fraction  of  days  in  n,  when  occurrence  of  solar  proton  event 
was  correctly  forecast, 

y  =  k  -  m  /k  is  the  fraction  of  days  In  k,  when  occurrence  of  solar  proton 
event  was  not  forecast, 

?  =  £-  n-  k  +  mis  the  number  of  days  (in  E)  when  non -occurrence  of  solar 
proton  event  (that  is,  safe)  was  correctly  forecast. 


X 

6 


£  -  n  ' 

_  £  -  k  -  ? 


imr 


n  =  k/£  is  the  fraction  of  days  in  £  when  solar  proton  event  was  forecast  to 
occur. 


A 


o 

n 
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